Bifrost: a Python/C++ Framework for High-Throughput Stream Processing in Astronomy
نویسندگان
چکیده
∗ Harvard-Smithsonian Center for Astrophysics, 60 Garden Street, Cambridge, MA 02138, USA † Department of Physics & McGill Space Institute, McGill University, Montreal, QC H3W 2C4, Canada ‡ NVIDIA Corporation, 2701 San Tomas Expressway, Santa Clara, CA 95050, USA § University of California, Berkeley, Campbell Hall 339, Berkeley CA 94720, USA ¶ Department of Physics and Astronomy, University of New Mexico, Albuquerque, NM 87131, USA ‖ Department of Atmospheric, Oceanic and Space Sciences, University of Michigan, Ann Arbor, MI 48109, USA ∗∗ Air Force Research Laboratory Space Vehicles Directorate, 3550 Aberdeen Ave. SE, Kirtland AFB, NM 87117, USA †† National Radio Astronomy Observatory, Socorro, NM 87801, USA
منابع مشابه
Geospatial Data Stream Processing in Python Using Foss4g Components
One viewpoint of current and future IT systems holds that there is an increase in the scale and velocity at which data are acquired and analysed from heterogeneous, dynamic sources. In the earth observation and geoinformatics domains, this process is driven by the increase in number and types of devices that report location and the proliferation of assorted sensors, from satellite constellation...
متن کاملHigh-Content Digital Microscopy with Python
High-Content Digital Microscopy enhances user comfort, data storage and analysis throughput, paving the way to new researches and medical diagnostics. A digital microscopy platform aims at capturing an image of a cover slip, at storing information on a file server and a database, at visualising the image and analysing its content. We will discuss how the Python ecosystem can provide such softwa...
متن کاملSrRietveld: a program for automating Rietveld refinements for high-throughput powder diffraction studies
SrRietveld is a highly automated software toolkit for Rietveld refinement. Compared to traditional refinement programs, it is more efficient to use and easier to learn. It is designed for modern high-throughput diffractometers and is capable of processing large numbers of data sets with minimal effort. The software currently uses conventional Rietveld refinement engines, automating GSAS and Ful...
متن کاملGC3Pie: A Python framework for high-throughput computing
This paper present GC3Pie [7], a python library to ease the development of scalable and robust High Throughput data analysis tools. Most of the current distributed computing middlewares as well as most of the in-house grown scripts fall short in reaching the scaling and reliability factors required by the ever growing demand of large data analysis. GC3Pie provides mechanisms to automitise the e...
متن کاملPyTables: Processing And Analyzing Extremely Large Amounts Of Data In Python
Processing large amounts of data is a must for people working in such fields of scientific applications as Meteorology, Oceanography, Astronomy, Astrophysics, Experimental Physics or Numerical simulation to name only a few. Existing relational or object-oriented databases usually are good solutions for applications in which multiple distributed clients need to access and update a large centrall...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- CoRR
دوره abs/1708.00720 شماره
صفحات -
تاریخ انتشار 2017